How to use this model on Windows 11?

#1
by alyxz - opened

Since Windows has a limitation on the size of executables, how can I use this model? Should I one of the following?

  1. Use llamafile.exe executable to run this model. But it seems the cli does not support running a llamafile.
  2. Get gguf from this model and run with llamafile.exe. But how to do this?

Sign up or log in to comment